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@ Global instruction scheduler for a computer. 

(g) A scheduler provides for global (intra-loop) scheduling of instructions to enable better utilisation of machine 
resources, in particular for a range of superscalar processors. The scheduler uses control and data dependence 
information, which is summarised in a program dependence graph, to move instructions well beyond basic block 
boundaries The scheduler can be tuned to schedule instructions for a range of superscalar machines through 
the use of a parametric machine description for the range of machines and a sets of heuristics for specific 
machines. The scheduler allows for the scheduling of both 'usefur and 'speculative' instructions. 
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The present invention relates to an instruction scheduler for a computer and in particular to an 
instruction scheduler which enables the scheduling of instructions beyond basic block boundaries (i.e. 
global scheduling) in a nnanner suitable for use with a parallel/pipelined computer. 

Instruction scheduling is a process of rearranging or transforming program statements before execution 
5 by a processor in order to reduce possible run-time delays between compiled instructions. Instruction 
scheduling is usually performed at an intermediate language or assembly code level. Such transformations 
must preserve data dependences and are subject to other constraints. This can be particularly advanta- 
geous when compiling for pipelined machine architectures, which allow increased throughput by overlap- 
ping instruction execution. For example, if there is a delay of one cycle between fetching and using a value 
10 V, it would be desirable to "cover" this delay with an instruction that is independent of V and is "ready" to 
be executed. 

A particular application for instruction scheduling is in the field of so-called Reduced Instruction Set 
Computers (RISC). An introduction to RISC computers can be found in the following article: 

Rl D.A. Patterson, D.A., "Reduced instruction set computers", published in the Communications of 
75 the ACM (Jan. 1985) at pages 8-21. 

The RISC approach to building high speed processors, which emerged in the late seventies, em- 
phasises the need for the streamlining of program instructions. As a result, instructions have to be 
rearranged, usually at the intermediate language or assembly code level, to take full advantage of pipelining 
and thereby to improve performance. The burden of the instruction scheduling, is placed on optimising 
20 compilers that generate code for RISC processors. Usually, the compilers perform instruction scheduling at 
the basic block level, solving most of the problems posed by the pipolined structure of RISC processors. 

An approach to scheduling at the instruction level for processors with several functional units is 
described in the following article: 

R2 D. Bernstein. J.M. Jaffe and M. Rodeh. entitled "Scheduling Arithmetic and Load Operations in 
25 Parallel with no Spilling", published in the SIAM Journal of Computing in Dec. 1989. 

Approaches to scheduling at the instruction level for pipelined machines are described in a number of 
articles listed below: 

R3 D. Bernstein and I. Gertner, "Scheduling Expressions on a Pipelined Processor with a Maximal 
Delay of one Cycle", published in the ACM Transactions on Programming Languages and 
30 Systems. Vol. 11, No. 1 (Jan. 1989) at pages 57-66; 

R4 D. Bernstein, M. Rodeh and 1. Gertner. "Approximation Algorithms for Scheduling Arithmetic 
Expressions on Pipelined Machines", published in the Journal of Algorithms, 10 (Mar. 1989) at 
pages 120-139. 

R5 J.J. Hennessy and T. Gross, "Postpass Code Optimisation of Pipeline Constraints", published in 
35 the ACM Transactions on Programming Languages and Systems 5 (July 1983) at pages 422-448. 

R6 P.B. Gibbons and S.S. Muchnick, "Efficient Instruction Scheduling for a Pipelined Architecture". 

published in the Proceedings of the ACM Symposium on Compiler Construction (June 1986) 
R7 H. Warren. "Instruction Scheduling for the IBM RISC System/6000 Processor", published in the 
IBM Journal of Research and Development Vol. 34, No 1 Jan 1990 at pages 85-92. 
40 An approach to scheduling at the instruction level for Very Long Instruction Word (VLIW) machines (i.e. 
machines where several conventional instructions for respective parts of a machine are combined) is 
described in the following thesis: 

R8 J.R. Ellis. "Bulldog: A compiler for VLIW architectures", Ph.D. thesis. Yale U/DCS/RR-364. Yale 
University, Feb. 1985. 

45 Whereas for machines with n functional units the idea is to be able to execute, as many as n instructions 
each cycle, for pipelined machines the goal is to issue a new instruction every cycle, effectively eliminating 
the so-called NOPs (No Operations). However, for both types of machines, the common feature required 
from the compiler is to discover in the code instructions that are data independent, allowing the generation 
of code that better utilises the machine resources. 

50 It was a common view that such data independent instructions can be found within basic blocks, and 
that there is no need to move instructions beyond basic block boundaries. A basic block is a sequence of 
consecutive instructions for which the flow of control enters at the beginning of the s quence and exits at 
the end thereof without a wait or branch possibility, except at the point of exit. Virtually, all of the previous 
work on the implementation of instruction scheduling concentrated on scheduling within basic blocks (see 

55 references R5, R6 and R7 above). 

Even for basic RISC architectures, however, such a restricted type of scheduling may result in code 
with many NOPs for a large family of programs including many Unix-type (Unix is a trademark of Unix 
System Laboratories Inc.) programs that include many small basic blocks terminated in unpredictable 
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branches. For scientific programs, where basic blocks tend to be larger, these problems tend not to be so 



severe. 



Recently, a new type of architecture is evolving that extends RISC by the ability to issue more than one 
instruction per cycle. See. for example, the following article: 
5 R9 R.D. Groves and R. Oehler, "An IBM second generation RISC processor architecture" published 
in the Proceedings of the IEEE Conference on Computer Design. (October 1989) at pages 134- 
137. 

This type of high speed processor organisation, called superscalar or superpipelined architecture, poses 
more serious challenges to compilers, since instruction scheduling at the basic block level is not sufficient 
10 to allow generation of code that utilises machine resources to a desired extent; see the following article: 

RIO N.P. Jouppi and D.W. Wall, "Available instruction-level parallelism for superscalar and super- 
pipelined machines" published in the Proceedings of the Third ASPLOS Conference. (April 
1 989) at pages 272-282. 

One recent effort to pursue instruction scheduling for superscalar machines was reported in the 
15 following article: 

R11 M.C. Golumbic and V. Rainish, "Instruction Scheduling beyond Basic Blocks" published in the 
IBM Journal of Research and Development Vol. 34 . No 1 Jan 1990 at pages 93-97. 
In this article, code replication techniques for scheduling beyond the scope of basic blocks were 
investigated resulting in considerable improvements of running time of the compiled code. However, the 
20 approach described still leaves room for further improvement. 

One can view a superscalar processor as a VLIW machine with a small number of resources. 
Approaches to compiling code for VLIW machines are described in reference R8 above, and also in the 

following articles: . „ u.,- u ^ • ♦u 

R12 J. Fisher, "Trace scheduling: A technique for global microcode compaction published in the 
25 IEEE Transactions on Computers, C-30. No. 7 (July 1981) at pages 478-490. 

R13 K. Ebcioglu. and T. Nakatani, "A new compilation technique for parallelising loops with un- 
predictable branches on a VLIW architecture" published in the Proceedings of the Workshop on 
Languages and Compilers for Parallel Computing, (August 1989), Urbana. 
The object of the present invention is to provide for an instruction scheduler which is able to perform 
30 global (i.e. intra-block) scheduling in an efficient and flexible manner. 

In accordance with a first aspect of the invention, there Is provided an instruction scheduler for a 
computer comprising program dependence graph generating logic for representing data and control 
dependences among instructions in an input code sequence and sequencing logic which Is responsive to 
the program dependence graph to re-order the instructions of the input code sequence, where appropnate 
35 beyond basic block boundaries, to generate an output code sequence. 

The invention enables global scheduling beyond basic block boundaries to be performed by use of the 
program dependence graph. The instruction scheduling can be applied before or after the register allocation 
phase of a compiler is invoked. It is advantageous to perform the scheduling before the register allocation 
step, so as to leave a greater degree of flexibility for reordering the instructions. 
40 Preferably, the program dependence graph generates a program dependence graph comprising a 
control dependence sub-graph and a data dependence sub-graph. The control dependence sub-graph 
represents the control dependences and the data dependence sub-graph represents the data dependences 
in the program defined by the Input code sequence. 

The sequencing (or scheduling) logic preferably schedules basic blocks of Instructions in the input code 
45 sequence block by block using the control dependence sub-graph; the sequencing logic determining, for a 
block currently being scheduled, a list of candidate blocks which can contribute instructions to the current 
block. In addition to the blocks that are identified in the control dependence sub-graph as equivalent to the 
current block and are dominated by the current block, the list of candidate blocks preferably includes all the 
blocks which are identified in the control dependence sub-graph as immediate successors of the current 
50 block or as immediate successors of the blocks that are equivalent to the current block and are dominated 
by the current block. 

From the data dependence graph, the sequencing logic can determine a set of candidate instructions 
from within the set of candidate blocks. The list of candidate instructions preferably Includes all instructions, 
including instructions whose execution is speculative, which belong to the current block or a block in the set 
55 of candidate blocks, unless the instruction is of a type which cannot be moved beyond a block boundary 
and/or the instruction is of a type which cannot be scheduled speculatively. It is from this list of candidate 
instructions that the sequencing logic determines one or more instructions to be scheduled next from the 
list of candidate instructions in accordance with a machine description. 
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The concept of speculative instructions is addressed in the tollowing articles: 

R14 K. Ebcioglu. "Some Design Ideas for a VLIW Architecture for Sequential-Natured Software" 

published In the Proceedings of the IFIP Conference on Parallel Computing, (August 1989); 
R15 M. D. Smith. M. S. Lam and M. A. Horowitz, "Boosting beyond Static Scheduling in a 
5 Superscalar Processor" published in the Proceedings of the Computer Architecture Conference 

(May 1 990) at pages 344-354. 
However, in these articles it is suggested that speculative instructions have to be supported by the 
machine architecture, which carries a significant run time overhead. In the present invention, this disadvan- 
tage can be overcome by the use of the data gathered in the program dependence graph. The prior art 
70 does not suggest the use of the program dependence graph for instruction scheduling. 

Indeed, in the present invention, the machine description is preferably stored as a parametric machine 
description representative of a range of computers and a set of scheduling heuristics for a specific 
computer. By the provision of a parametric machine description representative of a range of computers, and 
a set of scheduling heuristics for a specific computer, the instruction scheduler can be adapted to generate 
75 efficient code for a range of computers. By changing the set of heuristics, the scheduler can be fine tuned 
to specific computers within the range. 

The invention also includes a computer which comprises an instruction scheduler as defined above. The 
computer can have a superscalar/superpipelined architecture. 

In a preferred embodiment, the computer has a superscalar/superpipelined architecture. 
50 In accordance with a second aspect of the invention there is provided a method of scheduling 
instructions in a computer comprising the steps of: 

a) generating a program dependence graph representing data and control dependences among instruc- 
tions In an input code sequence; and 

b) scheduling instructions from the input code sequence using the program dependence graph so as to 
25 re-order the instructions of the input code sequence, where appropriate beyond basic block boundaries, 

to generate an output code sequence. 

A particular example of the present invention will be described hereinafter with reference to tables to be 
found at the end of the present description and to accompanying drawings in which: 

- Table 1 is an example of a program for explaining the operation of the invention; 

30 - Table 2 is an annotated sequence of machine instructions corresponding to part of the program of 
Table 1 ; 

- Table 3 illustrates the sequence of machine instructions of Table 2 following a first scheduling 
operation; 

- Table 4 illustrates the sequence of machine instructions of Table 2 following an alternative scheduling 
35 operation; 

- Figure 1 is a schematic block diagram providing an overview of an instruction scheduler in 
accordance with the invention; 

- Figure 2 is a control flow graph for the sequence of machine instructions of Table 2; 

- Figure 3 is a control dependence sub-graph of a program dependence graph for the sequence of 
40 instructions of Table 2; and 

- Figure 4 is a flow diagram representative of instruction sequencing logic in the instruction scheduler of 
Figure 1 . 

Figure 1 is a schematic block diagram providing an overview of an instruction scheduler 10 in 
accordance with the invention. The instruction scheduler takes as its input 11 a sequence of instructions and 
45 a control flow graph 12 for the sequence of instructions and provides as its output a rescheduled sequence 
of instructions 18. The instruction scheduler 10 comprises Program Dependence Graph Generation Logic 13 
for generating a Program Dependence Graph (PDG) 14 and sequencing logic (or scheduling logic) 15, 
which uses the PDG, along with a Parametric Machine Description (PMD) 16 and a set of heuristics 17 to 
reschedule the instructions. 

50 In this embodiment of the invention, the program dependence graph generation logic 13 and the 
sequencing logic 15 form part of a compiler, specifically one of the IBM XL family of compilers for the IBM 
RISC System/6000 computers. In this embodiment the program dependence graph 14, parametric machine 
description 16 and the set of heuristics 17. as well as the input and output sequences of instructions 11,17 
and th control flow graph 12, are held in the working storag of th IBM RISC System/6000 computer on 

55 which th compiler is running. For further information on the IBM RISC System/6000 computer family, 
reference is made to the articles published in the IBM Journal of Research and Development Vol. 34, No. 1, 
Jan 1990. 

The instruction scheduling can be applied before or after the register allocation phase of a compiler is 
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data dependences of the instructions in the code. The program dependence graph produced by the 
progrann dependence graph generation logic 13 connprises a control dependence sub-graph representing 
the control dependences and a data dependence sub-graph representing the data dependences. While the 
concept of data dependences, that carries the basic idea of one instruction computing a data value and 
another instruction using this value, was employed in compilers a long time ago, the notion of control 
dependences was introduced quite recently. See the following article: 

R16 J. Ferrante. K.J. Ottenstein, and J.D. Warren, "The program dependency graph and its use In 
optimisation", published in the ACM Transactions on Programming Languages and Systems, 
Vol. 9, No. 3 (July 1987) at pages 319-349. 

An example of a control flow graph 12 for use by the program dependence graph generation logic 13, 
specifically the control flow graph for the loop of Table 2, is illustrated in Figure 2. Conveniently, the control 
flow graph is stored in the memory of the computer on which the compiler is running in the form of a data 
structure having a set of linked records corresponding to the nodes in the graph, with the edges between 
the nodes represented by pointers between records. The control flow graph can be generated by 
conventional compiler logic for Identifying basic blocks and loops in the code sequence and for checking 
the status of the various processor registers on entry into each block. 

The control flow graph in Figure 2 is augmented with a unique ENTRY node and an EXIT node for 
convenience. In the following, it is assumed that there is a single ENTRY node In the control flow graph, but 
possibly several EXIT nodes. For strongly connected regions in the program (corresponding to the loops in 
the terminology used herein) the assumption of a single entry control flow graph corresponds to the 
assumption that the control flow graph is reducible. 

The meaning of an edge from a node X to a node Y in a control flow graph is that the control of the 
program may flow from the basic block X to the basic block Y. Usually the edges (i.e. the pointers in the 
data structure) are annotated with the conditions that control the flow of the program from one basic block to 
another. However, from the graph of Figure 4, it is not apparent which basic block will be executed under 
which condition. 

The generation of a control dependence sub-graph will now be described with reference to Figure 3. 
which represents the control dependence sub-graph for the loop of Table 2. Conveniently, the program 
dependence graph generation logic 13 generates a control dependence sub-graph in the form of a data 
structure having a set of linked records corresponding to the nodes in the graph, with the edges between 
the nodes represented by pointers between records. Each node of the graph corresponds to a basic block 
of the program, similarly to the control flow graph of Figure 2. However, an edge from a node X to a node Y. 
means that basic block Y will be executed under the condition computed at the end of basic block X, where 
the edges are again annotated with the corresponding conditions. In Figure 3 solid edges designate control 
dependence edges, while dashed edges will be discussed below. For example, in Figure 3 the edges 
emanating from B1 indicate that B2 and B4 will be executed if the condition at the end of 81 will be 
evaluated to TRUE, while 86 and 88 will be executed while the same condition is FALSE. 

For the purposes of global scheduling, the program dependence graph generation logic only generates 
a forward control dependence graph. In order to generate the control dependence sub-graph, the program 
dependence graph generation logic first generates a post-dominator tree identifying all the postdominating 
relationships and from this generates the forward control dependence graph. Control dependences that 
result from or propagate through the back edges in the control, flow graph are not generated. Thus control 
dependence sub-graph of Figure 3 is a forward control dependence graph. Note that forward control 
dependence graphs are a-cyclic. 

Comparing the graphs of Figures 2 and 3, we notice that certain edges that appear in the control flow 
graph (like the edge from 88 to 810) are not present in the control dependence sub-graph, while there are 
edges in the control dependence sub-graph (like the edge from 81 to 84) that did not exist in the control 
flow graph in the first place. From the control dependence sub-graph of the program dependence graph, it 
can be seen that basic blocks that have the same set of control dependences (like 81 and BIO, or 82 and 
B4, or 86 and 88 in Figure 3) can be executed in parallel up to the existing data dependences. This means 
that the instructions of such basic blocks can be scheduled together. 

Some definitions (D) will now be introduced to assist in an understanding of the scheduler, where X and 
Y be two nodes of a control flow graph. 

D1 - X dominates Y if and only if X appears on every path from ENTRY to Y. 

D2 - X postdominates Y if and only if X appears on every path from Y to EXIT. 

D3 - X and Y are equivalent if and only if X dominates Y and Y postdominates X. 

D4 - Moving an instruction from Y to X is said to be 'useful' if and only if X is equivalent to Y. 

D5 - Moving an instruction from Y to X is said to be 'speculative* if Y does not postdominate X (i.e. 
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invoked. It is advantageous to perform the instruction scheduling before the register allocation step, so as to 
leave a greater degree of flexibility for reordering the instructions. 

There follows a description of the parametric machine description 16. The parametric machine 
description is based on a generic model for a superscalar machine having a typical RISC processor whose 
5 only instructions that reference memory are load and store instructions, while all the computations are done 
in registers. The superscalar machine can be viewed as a collection of functional units of m types, where 

the machine has ni , n2 n^ units of each type. Each instruction in the code can be executed potentially 

by more than one unit of a specified type. 

Each Instruction requires an integral number of machine cycles to be executed by one of the functional 
10 units of its type. Also, there are pipelined constraints imposed on the execution of instructions which are 
modelled by the integer delays assigned to the data dependence edges of the program dependence graph. 

Consider the following example of two instructions, h and I2 .such that the edge (h , I2) is a data 
dependence edge. If t {t^1) is the execution time of h, d (d^O) is the delay assigned to (li, I2) and h is 
scheduled to start at time k. then, for performance purposes, I2 should be scheduled to start no earlier than 
75 k + t + d. Note, however, that if b is scheduled (by the compiler) to start earlier than mentioned above, this 
would not hurt the correctness of the program, since we assume the machine implements hardware 
interlocks to accommodate the delays at run time. More information about the notion of delays due to 
pipelined constraints can be found in references R3 and R4. Note that these delays may vary from 
architecture to architecture. 

20 The parametric machine description configures the generic model of a superscalar machine to fit the 

IBM RISC System/6000 machine. The IBM RISC System/6000 processor is modelled as follows: 

• m = 3 - there are three types of functional units: fixed point, floating point and branch types. 

• ni = 1. n2 = 1, ns = 1 - there is a single fixed point unit, a single floating point unit and a single 
branch unit. 

25 • Most of the instructions are executed in one cycle, however, there are also multi-cycle instructions, 
like multiplication, division, etc. 

• There are three main types of delays: 

• a delay of one cycle between a load instruction and the instruction that uses its result register 
(delayed load); 

30 • a delay of one cycle between a floating point instruction and the instruction that uses its result 

register; 

• a delay of three cycles between a compare instruction and the branch instruction that uses the 
result of the compare. More precisely, usually the three cycle delay between a compare and the 
respective branch instruction is encountered only when the branch is taken. However here for 

35 simplicity, It Is assumed that such a delay exists whether the branch is taken or not. 

The operation of the program dependence graph generation logic 13 is described below using as an 
example, a small section of code illustrated in Table 1. The program Illustrated In Table 1, which Is written 
In the C language, computes the minimum and the maximum of an array. In this program, concentrating on 
the loop which is marked In Table 1 . we notice that two elements of the array 'a' are fetched every iteration 

40 of the loop. Next, these elements of 'a* are compared one to another (if (u > v)), and subsequently they are 
compared to the maximum and minimum variables, updating the maximum and the minimum, if needed. An 
excerpt of the IBM RISC System/6000 pseudo-code for the loop in Table 1. that corresponds to the real 
code created by the XL-C compiler, is presented in Table 2. 

In this example, for reasons of ease of explanation, a feature of the IBM RISC System/6000 machine 

45 was disabled, namely keeping the iteration variable of the loop In a special counter register. Keeping the 
iteration variable in this register allows for decrement and test it for zero in a single instruction, effectively 
reducing the overhead for loop control instructions. 

For convenience, the instructions in the code of Table 2 are numbered from II to 120 and are annotated 
them with the corresponding statements of the program of Table 1 . Also, the ten basic blocks in the code of 

50 Table 2 are marked (B1-B10) for the purposes of the future discussion. 

Every instruction in the code of Table 2, except branches, requires one cycle in the fixed point unit, 
while the branches take one cycle in the branch unit. There is a one cycle delay between instruction 12 and 
13, due to the delayed load feature of an IBM RISC System/6000 computer. Also, there is a three cycle 
delay between each compar instruction and the corresponding branch instruction. Taking into consider- 

55 ation that the fixed point unit and the branch unit run in parallel, the code executes in an estimated 20, 21 or 
22 cycles, depending on whether 0, 1 or 2 updates of maximum and minimum variables (LR instructions) 
are done, respectively. 

The program dependence graph 14 is a convenient way to summarise all the control dependences and 
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If X is a basic block currently being scheduled, the sequencing logic identifies a set C(X) of candidate 
blocks for X ie a list of basic blocks which can contribute instructions to X. The determination of which 
blocks are candidate blocks is done from the control dependence graph in accordance with the principles of 
schedulinq to be applied. In the present embodiment there are two levels of scheduling: ^ . , ^ 

TuS instrucLs only: here C(X) includes all the blocks that are equivalent to X and are dominated 

byX. 

2. 1 -branch 'speculative': C(X) includes the following blocks: 

a. all the blocks that are equivalent to X and are dominated by X; 

b. all the immediate successors of X in the control dependence sub-graph: 

c all the immediate successors of blocks in "a" in the control dependence sub-graph. 
. After initialising (at 20) a set of candidate blocks for the current block, the sequencing logic computes 
(at 21) the set of candidate instructions for scheduling. Instructions which are ready for scheduling execution 
are held in a ready list. An instruction I is a candidate for scheduling in block X if it belongs to one of the 
following categories: 

• I belonged to X in the first place. 

♦ I belonqs to one of the blocks in the candidate set of blocks of X and: 

1. I is -useful' and is allowed to move beyond basic block boundaries. (There are instructions that are 

never moved beyond basic block boundaries, like calls to subroutines.) 

2 I is 'speculative' and I is allowed to be scheduled speculatively. 
Not all instructions are allowed to be scheduled speculatively. For example, 'speculative' loads may 
cause exceptions due to access to a non-existing virtual memory location. The sequencing logic determines 
which instructions may be scheduled speculatively and what payoff is expected in this case. 

The sequencing logic 15 then proceeds to schedule instructions (22) from the ready hst for a given 
instruction cycle. During the scheduling process the sequencing logic updates 'ist of ready instruc^^^^^^ 
i e 'useful- candidate instructions whose data and control dependences were fulfilled and speculative 
candidate instructions whose only data dependences are fulfilled. Every cycle as many instructions as 
required by the machine architecture are picked from the ready list to be scheduled next. If there are too 
many ready instructions, the "best" of them are chosen by the sequencing logic based on their pnority. 
Once an instruction is picked up to be scheduled, it is moved to the proper place in the code, and its data 
and control dependence to the following instructions are marked as fulfilled, potentially enabling rnew 
instructions to become ready. This process is repeated 23 until all the instructions in block X are scheduled. 
Then 25. the next block is scheduled until all the blocks in the loop are scheduled. , ' 

The relative priority of instructions for determining the instruction to be scheduled next by the 
sequencing logic at step 22. is derived in accordance with the set of heuristics. For example the max.mal 
number of delays in the path to the root of the data dependence sub-graph of the basic block to which the 
instruction belongs is chosen as a heuristic for fixing the priority of an instruction. However, other heuristics 
may be used instead or in addition to this heuristic. Table 3 illustrates an example of how global scheduling 
works 

Specifically. Table 3 illustrates the result of applying global scheduling to the instruction sequence of 
Table 2 with only so-called useful instructions being permitted to move beyond the basic block boundanes. 
The code illustrated In Table 3 executes in about 13 cycles per iteration of the loop. 

Table 4 illustrates the result of applying global scheduling to the instruction sequence of Table 2 where 
It speculative scheduling is also performed (i.e. where speculative instructions are also permitted to move 
beyond the basic block boundaries). The code illustrated in Table 3 executes in about 12 cycles per 

Iteration of the loop. • n 

A scheduler for global instruction scheduling has been described which allows to move instructions well 
beyond basic blocks boundaries within the scope of the enclosed loop. The scheduler employs a Program 
Dependence Graph, which was proposed by Ferrante et. al. (see reference R14) for use in compilers to 
expose parallelism for the purposes of vectorisation and generation of code for multiprocessors. The 
scheduler uses this program dependence graph in combination with a parametric description of a family of 
superscalar machines to provide a powerful framework for global instruction scheduling by optimising 
compilers. 

The scheduler uses a set of heuristics to provide a relative priority of an instruction in program 
dependence graph. The set of heuristic rules employed is dependent on the specific architecture of the 
machine for which the scheduler is intended. An example of the sort of heuristic rules relate to critical path 
information. The scheduler issues instructions according to their priority, trying to fully utilise machine 
resources, as described above. By changing the set of heuristic rules, the scheduler is fine tuned to a 
selected machine architecture, without changing the other parts of the scheduler. 
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such instructions are said to be 'speculative*, since their result may be used in only some of the 
possible executions of the program). 

• D6 - Moving an instruction from Y to X is said to require duplication if X does not dominate Y. 

The sequencing logic 15 employs the control dependence sub-graph for both 'usefuP and ^speculative' 
6 scheduling. To find equivalent nodes, the sequencing logic searches the control dependence sub-graph 
data structure for nodes that are identically control dependent, i.e. they depend from the same set of nodes 
under the same conditions. For example, in Figure 3, B1 and B10 are equivalent, since they do not depend 
on any node. Also, B2 and 84 are equivalent, since both of them depend on 81 under the condition TRUE. 
In Figure 3 the equivalent nodes are marked with the dashed edges, the direction of these edges providing 
10 the dominance relation between the nodes. For example, for equivalent nodes 81 and 810, 81 dominates 
810. 

Tho control dependence sub-graph provides "the degree of speculativoness" for moving instructions 
from one block to another. When scheduling a 'speculative' instruction, there is always a gamble on the 
outcome of one or more branches; only when the direction of these branches is guessed correctly, does 

75 moved instruction become profitable. However, nothing is lost if the guess was wrong, it is just that nothing 
is gained. The control dependence sub-graph provides for every pair of nodes the number of branches 
gambled on (in case of 'speculative' scheduling). For example, when moving instructions from 88 to 81, a 
gamble is made on the outcome of a single branch, since when moving from 88 to 81 in Figure 3. only a 
single edge is crossed. Note that this is not apparent from the control flow graph of Figure 2. When moving 

20 from 85 to 81 there is a gamble on the outcome of two branches, since two edges of Figure 3 are crossed. 
From the above, a further definition can be derived: 

• D7 - Moving instructions from Y to X is said to be N-branch 'speculative* if a path exists in the control 
dependence sub-graph from X to Y of length N. 

Given definition D7, 'useful' scheduling can be said to be 0-branch 'speculative'. 
25 While the program dependence graph generation logic computes control dependences on the basic 
block level, it computes data dependences on the instruction by instruction basis. Both intrablock and 
interblock data dependences are computed. A data dependence may be caused by the usage of registers 
or by. accessing memory locations. 

For two instructions in the code, 'Ix' and 'ly, a data dependence edge from Ix to ly is inserted into the 
30 data dependence sub-graph in one of the following cases: 

• a register defined in Ix is used in ly (flow dependence); 

• a register used in Ix is defined in ly (anti-dependence); 

• a register defined in Ix is defined in ly (output dependence); 

• both a and b are instructions that touch memory (loads, stores, call to subroutines) and it is 
35 impossible to prove that they address different locations. 

The data dependence edges leading from a definition of a register to its use carry a (potentially non- 
zero) delay, which is a characteristic of the underlying machine. The rest of the data dependence edges 
carry zero delays. 

As examples of data dependences, consider the data dependences for basic block 81 in Table 2 
40 referencing instructions by their numbers from Table 2. There is an anti dependence from II to 12, since II 
uses r31 and 12 defines a new value for r31. There is a flow data dependence from both II and 12 to 13, 
since 13 uses r12 and rO defined in 11 and 12, respectively. Edges (11.13) and (12.13) carry a one cycle delay, 
since both 11 and 12 are load instructions (delayed load). There is a data dependence edge from 13 to 14. 
since 13 sets cr7 which is used by 14. This edge has a three cycle delay, since 13 is a compare instruction 
45 and 14 is a corresponding branch instruction. 

It is important to notice that, since both the control and data dependences computed are a-cyclic. the 
resultant program dependence graph is a-cyclic as well. This facilitates convenient scheduling of instruc- 
tions by the sequencing logic. 

The sequencing logic schedules instructions in the program on a loop by loop basis. It starts with the 
50 innermost loops, followed by the outer loops. There are a few principles that govern the scheduling process 
in general: 

• Instructions are never moved out or into the loops. 

• All the instructions are moved in the upward direction, i.e they are moved against the control flow 
edges. 

55 • The original order of branches in the program is preserved. 

Figure 4 is a flow diagram illustrating the scheduling of instructions by the sequencing logic. This is 
done by processing the basic blocks one at a time. The basic blocks are encountered in the topological 

ntrr»i flow nranh frnm X to Y. then X is orocessed before Y. 
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During the scheduling process instructions are allowed to nnove from one basic block to another up to 
existing control and data dependences. In this framework 'useful' instructions are allowed, meaning, only 
instructions whose result is used at least once during execution of the program are scheduled. Optionally, 
•speculative' instructions can be moved as well within desired constraints. In this more aggressive approach 
5 to instruction scheduling, such 'speculative* instructions are moved from basic block X to basic block Y; that 
is, in disregard to any control dependence that exists from X to Y, If a 'speculative' instruction is moved to a 
place where it will be executed by otherwise idle functional unit, then such a transformation can only 
improve the running time of the program and is considered profitable. 
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/* find the largest and the smallest niimbor in n given array */ 
mainO { 
statical] — { 

5,5,5,2,5,5.5.5.5,5,5,5,5,5,5,5.5,5. 
5,5,5,5,5,5,5,5.5,5,5,5,5,5,5,5,9, 



75 



int i , u , V , m in , max , n=s i zeo f ( a ) / s 1 zee f ( nLO] ) ; 
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while (i < n) { 

u=a[i]; v=a[i+l]; 
if Cu>v) { 

if Cu>max) max=u; 
if Cv<min) min=v; 



else 
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if (v>max) max=v; 
if (u<min) min=u; 



i= i+2; 



/iV^V**Vc*iV*-A"A"»VVr^VrAr:fr,V^VVr LOOP ENDS Vr**VrVf •fr-'rnV:l'f 

printf ("min=%d max=%d\n" ,min,max) ; 



-«„V-.'.-^V-iV-iV-.V-tVVr:V-:'rVrV'fyrVr^'fr-frVr'fr* * * * * * / 
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. , . more instructions here ... 
CL.O: 

(II) L rl2=a(r31,4) lo?id u 
5 (12) LU rO, r31=a(r31,8) lond v 

(13) C cr7=rl2,rO ii > v 

(14) BF CL.4,cr7.0x2/gt 

, 1--- END BLl 

(15) C cr6=rl2,r30 u > max 

(16) BF CL.6,cr6,0x2/gt 

1 . END BL2 

'° (17) LR r30=rl2 max = u 

- END BL3 

CL. 6: 

(IB) C cr7=rO,r28 v < min 

(19) BF CL.9,cr7,0x]/lt 

1 END BL4 

(110) LR r28=rO min = v 

(III) B CL.9 

END BL5 

CL.4: 

(112) C cr6=rO,r3() v > max 

END BL6 

..tc!.:.!.. bl7 

CL. 11: 

(115) C cr7=rl2,r28 u < min 

^litL...ll END BL8 

lllZlll - -.-T!']-:-:!-. END BL9 

CL 9 : 

(118) ' AI r29=r29,2 i = i+2 

(119) C cr4=r29,171 i<n 
30 (120) BT CL. O, cr4,0xl/ It 

i.-.l-.-l - - end blio 

VfVt-A-VrVt-frA-^^yr-fr^Vt-A+WVfVt* LOOP ENDS *r**TV***VHV*Vf*^VVrTiVyrVr*V'rVrnVVrVrVr:flrVHHt** 

. . , more instructions here . . . 
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. . . more instructions here ... . . 

Vt*-.Vyr-/ryr*-.V****VrVr*VrVk-:.ViV LOOP STARTS **,VyfT.VVcVr,VVrVrV".r ..-.r. r-r%. VrVr/i--fr*yf* 

CL.O: 

rl2=a(r31,4) 
rO,r3l=a(r31,8) 
r29=r29, 2 
cr7=rl2,rO 
cr4=r29, 171 
CL.4,cr7,0x2/gt 
cr6=rl2,r30 
cr7=rO, r28 
CL. 6,cr6.0x2/gt 
r30=rl2 

CL.9,cr7,0xl/lt 
r28=rO 
CL.9 

cr6=r0, r30 
cr7=rl2,r28 
CL. 11 ,cr6,0x2/gt 
r30=rO 

CL.9,cr7,Ox)/lt 
r28=rl2 

CL. 0,crA,Oxl/lt ^^^^ 

-*****ytyfVr^**-A-Vr LOOP ENDS Vr***Vr*Vi-iV*VfVrVr-;:Vr.V,VVrVf.VVr,V**i.V.V*yc*** 

more instructions here ... 



K ^ ^ J 




L 






LU 


f 118^ 




AI 






C 


V. 1. X ^ J 




C 






BF 


(15) 




C 


( 18) 




C 


(16) 




BF 


(17) 




LR 


CL. 


6; 




(19) 




BE 


(110) 




LR 


(111) 




B 


CL. 


4 




(112) 




'c 


(115) 




C 


(113) 




BF 


(114) 




LR 


CL. 


11: 


(116) 




BF 


(117) 




LR 


CL. 


9 




(120) 




' BT 



TABLE 3 
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. . . more instructions here ... 

VfVt*Vr***Vf-fr***Vr**-A-Vryf-»V LOOP STARTS Vr*:fr**T.VVir*ifr*VrVWrV:Vr^V^V--r-.r^f-.."..-VfVf/r** 

rl2=a(r31,4) 
r0,r31=a(r31,8) 
r29=r29,2 
cr7=rl2,r0 
cr4=r29, 171 

_ cr6=rl2,r30 

70 (112) C cr5=rO,r30 

CL.A,cr7,0x2/gt 
cr7=rO,r28 
CL.6,cr6,0x2/gt 
r30=rl2 

15 (19) BF CL.9,cr7.0xl/lt 

r28=rO 
CL.9 

cr7=rl2,r28 
CL. Il,cr5,0x2/gt 
r30=rO 

CL.9,cr7,Oxl/lt 
r28=rl2 



CL. 


0: 




(11) 




L 


(12) 




LU 


(118) 




AT 


(13) 




C 


(119) 




C 


(15) 




C 


(112) 




C 


(14) 




BF 


(18) 




C 


(16) 




BF 


(17) 




LR 


CL. 


6 




(19) 




BF 


(110) 




LR 


(111) 




B 


CL, 


4 




(115) 




C 


(113) 




BF 


(114) 




LR 


CL. 


.11: 


(116) 




BF 


(117) 




LR 


CL 


.9 




(120) 




BT 
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CL,0,cr4,0xl/lt 

VHt*******VtVnVVf LOOP ENDS *^*Vc-V*****Vr/r*iV.V^rVr.VVr.VVr.V-VVr:;t***.V* 

more instructions hero ... 
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1. Instruction scheduler for a computer comprising: 

program dependence graph generating logic for generating a program dependence graph repre- 
50 senting data and control dependences among instructions in an input code sequence; 

. sequencing logic which is responsive to the program dependence graph to re-order the instructions 
of the input code sequence, where appropriate beyond basic block boundaries, to generate an output 
code sequence. 

55 

2- An instruction scheduler as claimed in claim 1 wherein the program dependence graph generating logic 
generates a program dependence graph comprising a control dependence sub-graph and a data 

dependence sub-graph. 
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An instruction scheduler as claimed in claim 2 wherein the sequencing logic schedules basic blocks of 
Tnst uc ions in the input code sequence block by block using the control dependence si^b-graph the 
sequencing logic determining, for a block currently being scheduled, a list of candidate blocks wh,ch 
can contribute instructions to the current block. 

An instruction scheduler as claimed in claim 3 wherein the list of candidate blocks Includes all the 
blocks that are identified in the control dependence sub-graph as equivalent to the current block and 
are dominated by the current block. 

An instruction scheduler as claimed in claim 4 wherein the list of candidate blocks fditionally includes 
all the blocks which are identified in the control dependence sub-graph as immediate successors of the 
current block or as immediate successors of the blocks that are equivalent to the current block and are 

dominated by the current block. 

An instruction scheduler as claimed in any one of claims 3 to 5 wherein the sequencing logic 
additionally determines, using the data dependence graph, a set of candidate instructions from within 
the set of candidate blocks. 

An instruction scheduler as claimed in claim 6 wherein the list of candidate instructions <'^^f^^^^^^ 
instructions, including instructions whose execution is speculative, which belong to the ^^''^^'^'^^^^^^ 
a block in the set of candidate blocks, unless the instruction is of a type which cannot be moved 
beyond a block boundary and/or the instruction is of a type which cannot be scheduled speculatively. 

An instruction scheduler as claimed in claim 6 or claim 7 wherein the sequencing logic determines^ one 
or more instructions to be scheduled next from the list of candidate instructions in accordance with a 
machine description. 

9 An instruction scheduler as claimed in any preceding claim comprising means for storing a machine 
description comprising a parametric machine description representative of a range of computers and a 
30 set of scheduling heuristics for a specific computer. 

10. A computer comprising an instruction scheduler as claimed in any preceding claim. 

11. A computer as claimed in claim 10 wherein the computer has a superscalar/superpipelined architecture. 

35 

iZ A method of scheduling Instructions in a computer comprising the steps of: 

a) generating a program dependence graph representing data and control dependences among 
Instructions In an input code sequencefand 

b) scheduling instructions from the input code sequence using the program dependence graph so as 
40 to re-order the Instructions of the input code sequence, where appropriate beyond basic block 

boundaries, to generate an output code sequence. 

13. A method as claimed in claim 12 wherein the program dependence graph generated in step (a) 
comprises a control dependence sub-graph and a data dependence sub-graph. 

45 

14. A method as claimed in claim 13 wherein, in step (b) basic blocks of instructions in the input code 
sequence are scheduled block by block using the control dependence sub-graph, and wherein step (b) 
comprises, for each block as it is being scheduled, the sub-step of 

b)(i) determining a list of candidate blocks which can contribute 
50 instructions to the current block. 

15. A method as claimed in claim 14. wherein the list of candidate blocks includes all the blocks that are 
identified in the control dependence sub-graph as equivalent to the current block and are dominated by 
the current block. 

16. A method as claimed in claim 15 wherein the list of candidate blocks additionally includes all the blocks 
which are identified in the control dependence sub-graph as immediate successors of the current block 
or as immediate successors of the blocks that are equivalent to the current block and are dominated by 
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the current block. 

17. A method as claimed in any one of claims 14 to 16 comprising the sub-step of 

b)(ii) determining, using the data dependence graph, a set of 
candidate instructions from within the set of candidate blocks. 

18. A method as claimed in claim 17 wherein the list of candidate instructions includes all instructions, 
including instructions whose execution is speculative, which belong to the current block or a block in 
the set of candidate blocks, unless the instruction is of a type which cannot be moved beyond a block 
boundary and/or the instruction is of a type which cannot be scheduled speculatively. 

19. A method as claimed in claim 17 or claim 18 comprising a sub-step of: 

b)(iii) determining one or more instructions to be scheduled next from 
the list of candidate instructions in accordance with a machine description. 

20. A method as claimed in claim 19 wherein the machine description comprises a parametric machine 
description representative of a range of computers and a set of scheduling heuristics for a specific 
computer. 
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@ A scheduler provides for global (intra-loop) 
scheduling of instructions to enable belter utilisation 
of machine resources, in particular for a range of 
superscalar processors. The scheduler uses control 
and data dependence information, which is sum- 
marised in a program dependence graph, to move 
instructions welt beyond basic block boundaries. The 
scheduler can be tuned to schedule instructions for 
a range of superscalar machines through the use of 
a parametric machine description for the range of 
machines and a sets of heuristics for specific ma- 
chines. The scheduler allows for the scheduling of 
both 'useful* and 'speculative' instructions. 
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